Maze exploration behaviors using an integrated evolutionary robotics environment
نویسندگان
چکیده
This paper presents results generated with a new evolutionary robotics (ER) simulation environment and its complementary real mobile robot colony research test-bed. Neural controllers producing mobile robot maze searching and exploration behaviors using binary tactile sensors as inputs were evolved in a simulated environment and subsequently transferred to and tested on real robots in a physical environment. There has been a considerable amount of proof-of-concept and demonstration research done in the field of ER control in recent years, most of which has focused on elementary behaviors such as object avoidance and homing. Artificial neural networks (ANN) are the most commonly used evolvable controller paradigm found in current ER literature. Much of the research reported to date has been restricted to the implementation of very simple behaviors using small ANN controllers. In order to move beyond the proof-of-concept stage our ER research was designed to train larger more complicated ANN controllers, and to implement those controllers on real robots quickly and efficiently. To achieve this a physical robot test-bed that includes a colony of eight real robots with advanced computing and communication abilities was designed and built. The real robot platform has been coupled to a simulation environment that facilitates the direct wireless transfer of evolved neural controllers from simulation to real robots (and vice versa). We believe that it is the simultaneous development of ER computing systems in both the simulated and the physical worlds that will produce advances in mobile robot colony research. Our simulation and training environment development focuses on the definition and training of our new class of ANNs, networks that include multiple hidden layers, and time-delayed and recurrent connections. Our physical mobile robot design focuses on maximizing computing and communications power while minimizing robot size, weight, and energy usage. The simulation and ANN-evolution environment was developed using MATLAB. To allow for efficient control software portability our physical evolutionary robots (EvBots) are equipped with a PC-104-based computer running a custom distribution of Linux and connected to the Internet via a wireless network connection. In addition to other high-level computing applications, the mobile robots run a condensed version of MATLAB, enabling ANN controllers evolved in simulation to be transferred directly onto physical robots without any alteration to the code. This is the first paper in a series to be published cataloging our results in this field. © 2004 Elsevier B.V. All rights reserved.
منابع مشابه
Incremental Embodied Chaotic Exploration of Self-Organized Motor Behaviors with Proprioceptor Adaptation
*Correspondence: Phil Husbands, Department of Informatics, Centre for Computational Neuroscience and Robotics, University of Sussex, Falmer, Brighton BN1 9QJ, UK e-mail: [email protected] This paper presents a general and fully dynamic embodied artificial neural system, which incrementally explores and learns motor behaviors through an integrated combination of chaotic search and reflex learni...
متن کاملIntegrated Design, Deployment and Inference for Robot Ecologies
Evolutionary computation (EC) has been used extensively for the automated design of robot controllers (see [4] for an overview); more recently, robots themselves have been automatically designed using evolutionary techniques [5], [1]: the morphology and controller of the robot is evolved together to produce robots that exhibit increasing efficacy at performing the desired task. Evolutionary tec...
متن کاملSelf-Evolution of Target Tracking Behavior in Mobile Robot using Direct Competition
This paper represents work done in Evolutionary Robotics and compiles results obtained after simulating the competitive game of reaching the target in a software environment with minimum sensors present. Neural network controllers were evolved from sub minimal controllers to learn first obstacle avoidance behavior, then maze exploration and finally the task of target tracking using direct compe...
متن کاملLearning Algorithms for Small Mobile Robots: Case Study on Maze Exploration
An emergence of intelligent behavior within a simple robotic agent is studied in this paper. Two control mechanisms for an agent are considered — new direction of reinforcement learning called relational reinforcement learning, and a radial basis function neural network trained by evolutionary algorithm. Relational reinforcement learning is a new interdisciplinary approach combining logical pro...
متن کاملEvolution of Autonomous Self-righting Behaviors for Articulated Nanorovers
Miniature rovers with articulated mobility mechanisms are being developed for planetary surface exploration on Mars and small solar system bodies. These vehicles are designed to be capable of autonomous re. covery from overturning during surface operations. This paper describes a computational means of developing motion behaviors that achieve the autonomous recovery function. It proposes a cont...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Robotics and Autonomous Systems
دوره 46 شماره
صفحات -
تاریخ انتشار 2004